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Abstract 

We consider an infinite-range spherical p-spin glass model with an additional r-spin ferromag- 
netic interaction, both statically using a replica analysis and dynamically via a generating 
functional method. For r > 2 we find that there are first order transitions to ferromagnetic 
phases. For r < p there are two ferromagnetic phases, one non-glassy replica symmetric and 
one exhibiting glassy one-step replica symmetry breaking and aging, whereas for r p only 
the replica symmetric phase exists. 

1 Introduction 

The infinite-ranged spherical spin glass with p > 2 body random exchange interactions has at- 
tracted significant attention recently for a number of reasons. Among these are (i) it is exactly 
soluble in the thermodynamic limit both for its equilibrium properties and for its off-equilibrium 
macrodynamics (at least in the sense of coupled equations for macroscopic order functions and 
ansatze solving them in a long time limit), (ii) it exhibits replica symmetry breaking (RSB) and 
aging glassy macrostates, (iii) the RSB is of the one-step kind (1RSB) even down to the lowest 
temperatures. (In its discontinuous variant, 1RSB is believed to be symptomatic of many systems 
exhibiting glassy behaviour without Hamiltonian disorder.) 

The original work and most subsequent advances have concentrated on situations where 
the exchange distribution is symmetric, albeit possibly with an external field. More recently an 
extension was introduced to allow for an additional ferromagnetic interaction, stimulated by the 
existence of many physical systems with large coherently coordinated attractors, such as most real 
spin glass materials with appropriate concentrations PJ , neural networks Q , proteins |6| , and error- 
correcting codes (?]]. This extension was however limited to two-body ferromagnetic exchange, with 
corresponding second-order ferromagnetic transitions. In this paper we extend the study further to 
include r > 2 body ferromagnetic interactions for which the onset of ferromagnetism is first order. 
This is of relevance both for application to real systems (for example, for error-correcting codes 
r = p) and since it brings in new features (spinodal and thermodynamic transitions, metastability, 
and suppression of glassy ferromagnetism). 

2 The model 

The Hamiltonian we use is 

H= J ix-i p <f>ix £ </>ii---4>ir (!) 



Jo(r-l)! 

N r-1 

ii<i-2---<i P ii<i2---<i r 



where the Ji ± ...i are independent quenched random couplings given by a Gaussian distribution 
with zero mean and variance pi J 2 /2N P ~ 1 . The spins 4>i are real numbers subject to the spherical 
constraint 
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We consider p > 2 so that replica symmetry is broken for low temperatures, spherical spins so that 
1RSB is sufficient at all temperatures, and infinite-ranged interactions so that mean field theory 
is exact. For r — 1 this reduces to the model of [0,^), for r — 2 it becomes that of ||, but we shall 
be interested also in r > 2. 

In considering the phase diagram, we will identify lines of four types. Since there are first order 
transitions, in the statics we must consider the spinodal lines (where a phase appears) and the 
thermodynamic lines (where it becomes thermodynamically preferred due to its free energy). A 
modified replica analysis employing the criterion of marginal stability (MS) leads to a different set 
of spinodal lines. Finally, there are spinodal lines generated by a study of the Langevin dynamics 
at long times. As in the cases studied previously, with an external field [g] or a 2-spin coupling 
the dynamic lines are identical to the MS lines. 



3 Replica theory 

The equilibrium properties of this model are given by the replica method |9| in which one- 
step replica symmetry breaking is sufficient. This generates four order parameters governed by 
self-consistent equations. Three of these describe the probability distribution P(q) of the overlap 
between pure states: P(q) has two <5-function spikes, one corresponding to the self-overlap 
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and one corresponding to the mutual overlap 
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where (. . .) s refers to the thermodynamic average over the microstates of the pure state S and 
[. ..]av to the average over the quenched disorder; the strength of these two arc 1 — x and x 
respectively. The fourth order parameter is the magnetization M. 

The replica free energy F is, in the thermodynamic limit (N — > oo), given by 
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where the replica indices a and b run from 1 to n, and M ® M represents the outer product of the 
vectors. Under the 1RSB ansatz f[L0| this becomes 
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where we have defined an average over P(q): for any value of m, 

^=(l-x)qT+xq^. (7) 
Stationarity of F leads to the self-consistent equations. Extremising with respect to M gives 
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with respect to go and qi gives 
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and with respect to x gives 



1 o2 J 2 (P P s, 1 i ( 3i-3o . (3o - M 2 )( qi - q Q ) 
.- f 3J { f 1 - q r ) + -ln^—J-- u - ¥) + ^— -0. (11) 



For the statics, equations <M), (H), (hOT) and (11) are solved for M, qo, qi, and x. We also find 



it useful to consider the free energy with the magnetization constrained; in this case (ph does 



not apply. For the calculation under marginal stability, we abandon (11), and instead insist that 
the lowest eigenvalue of the Hessian matrix of (j^) in the q a b should vanish, which is to say that 
the system should be marginally stable against small fluctuations in the overlaps. The resulting 
equation is 

' Vp-l^AT^O. (12) 
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4 Dynamics 

The dynamics used are given by the Langevin equation 

^ = -^-z(t)Mt)+m, as) 

where £i(t) is a Gaussian thermal noise with zero mean and satisfying 

mMt')) = ^ ij s(t-t'), (14) 

and z{t) is introduced to enforce the spherical constraint (|^). The standard generating function 
procedure |0,n2] yields a self-consistent mean-field equation of motion: 



^ = ~p(p - l)/3 2 J 2 J* df G(t, t')cp- 2 (t, t'W) + b(t) - z{t)4>{t) + r,{t) , (15) 

where the effective reduced field is b(t) = f3JoM r ~ 1 (t), the local response function is G(t,t') = 
S((f>(t)) /Sb(t'), the correlation function is C(t,t') — (cf)(t)(f)(t')) , the magnetization is M(t) = (4>(t)), 
and there is a renormalized Gaussian noise rj(t) with zero mean and satisfying 

( V (tw)) = m - o + l - P p 2 j 2 ^- 1 ^, t 1 ) . (i6) 

This equation cannot be solved exactly, but it is possible to obtain self-consistent equations using 
the standard aging assumption |l3| 

C(t,t') = C st (t-t')+C{t'/t), 

1 (17) 
G(t,t') = G st (t-t') + ~G{t'/t), 

taking the limit of long times and setting all the time derivatives to zero. The calculation follows [Q] 
and, as expected, gives the equations (|), (|), ©, and ( |l^ ) obtained in the MS version of the 
replica analysis, identifying 

C(l) = 3i, C(0) = 3o, 

Grt(0) = l-?i, C st (oo)=0, 1 ' 

and M = M(oo). The role played by x is that of a factor in a modified fluctuation-dissipation 
theorem (QFDT) in the non-ergodic phase: 

lg{t'/t) = - x mt'/t)^J^. (19) 

There is a direct correspondence between the breaking of replica symmetry and the breaking of 
ergodicity. 
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5 Results and interpretation 



Phase diagrams for a characteristic set of situations are exhibited in Figures the new results 
are in Figures || [| but Figures [l] and || are included for orientation (as well as completeness). In 
each case p = 4 is chosen, but similar results apply for other p 3. The remaining figures show 
the free energies of systems with constrained magnetizations: these assist in the interpretation of 
the phase diagrams which result when the constraint is removed and the free energy minimized 
with respect to M. 

Figure |l| is for r — 1 in which case the second term of ([!]) corresponds to an applied 

field h = Jq. It is helpful to recall its features. For h > h c the only stable state is paramagnetic. 
For h between h c and h m there is a continuous one-step replica symmetry breaking (C1RSB) 
transition from paramagnet to spin glass, with (qi — go) — > at the transition; the transition 
temperature is the same statically and dynamically, and the transition coincides with the onset 
of Almeida-Thouless instability. At h = h m , this temperature reaches a maximum of T m . For 
h < h m there is a discontinuous one-step replica symmetry breaking (D1RSB) transition from 
paramagnet to spin glass, with x — ► 1 at the transition. The transition temperature is higher for 
dynamics (or equivalently marginal stability) than for statics; both transition temperatures are 
higher than that at which small fluctuation Almeida-Thouless instability would onset were it not 
preempted by the discontinuous transition. All three temperatures, which we shall label T^, T s , 
and Tat respectively, fall as h falls; for future use we define T s = T s ° at h = 0. In considering 
the various systems with ferromagnetic interactions discussed below it will be helpful to make 
reference to this case. 

Before passing to the generalized models it is also useful to consider the system with Jq = (for 
which case the value of r is irrelevant) but with constrained magnetization. For T > T m the free 
energy as a function of M has the form shown in Figure ^(a): the stable state is replica symmetric 
for all M. As T is reduced below T m the character of f(M) changes as shown in Figure ^|(b), or in 
more detail in Figure ^|(c) : a gap opens up in which there is no longer an RS solution stable against 
Almeida-Thouless fluctuations, and a region in which there is a new RSB solution appears. The 
RSB solution spans the gap in the RS solution, with an overlap at its lower end. That is, the upper 
end-point of the RSB curve coincides with the lower end-point of the high-M section of the RS 
curve, but the lower end-point of the RSB curve lies on the low-M section of the RS curve below 
its end-point. The RSB solution has monotonically increasing (gi — go) as M is lowered below the 
upper connection point of RS and RSB. The coincidence at the upper end of the gap is related to 
the possibility of a continuous RSB, while the overlap at the lower end is related to a discontinuous 
RSB. As the temperature is lowered further the gap in the RS curve and range of RSB both grow, 
with the latter extending to M = at T ^ T s °, as shown in Figure ||(d). For Jq = the minimum 
of f(M) is always at M = which is therefore the unconstrained magnetization. For T < T s °, 
where both RS and RSB solutions exist at M — 0, the latter is favoured. 

Increasing h = Jq for r = 1 modifies the curves f(M) and moves the minimum to a finite 
magnetization M — M m ; n . For T > T m , f(M) remains only RS and the unconstrained state 
remains paramag netic. For T s ° < T < T m , where there is an RSB curve which does not extend to 
M = 0, the sequence of events on increasing h is as follows: (i) the minimum moves out along the 
lower section of the RS curve, (ii) it crosses into the region where the RS and RSB curves overlap 
and both have minima, the RSB being favoured so that a D1RSB transition to a spin glass takes 
place; (iii) the RSB minimum continues to move out, while the RS minimum reaches the end of 
the lower RS branch and disappears, corresponding to crossing the Almeida-Thouless line, but the 
RS minimum is irrelevant and no phase change occurs; (iv) the RSB minimum moves up the RSB 
curve until this gives way smoothly to the upper section of the RS curve and a C1RSB transition 
back to a paramagnet takes place. For T < T m again the RSB curve does extend to M = and 
the system already favours the spin glass solution at h — 0, so only (iii) and (iv) occur. 

For r 2 ferromagnetism becomes possible with effective field 

h cS = J M r - x (20) 
determined self-consistently. Figure || shows the phase diagram obtained recently j| for r = 2. 
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At low Jo the frustration due to the disorder in J continues to prevent ferromagnetism, as does 
entropy as the temperature is raised, leading to behaviour similar to that for Jo = 0. At a 
temperature-dependent Jo a continuous ferromagnetic transition takes place and the system goes 
over to a solution whose magnetization rises continuously with Jo. The ferromagnetic region is 
split into two parts, non-glassy RS (at higher Jo, T) and glassy 1RSB (at lower Jo, T). The 
transition between them directly mirrors the behaviour of Figure with h replaced by the self- 
consistently determined h c s and is D1RSB (C1RSB) for Jo less (greater) than the value Jm' for 
which h e ft = h m . (The transition temperature reaches the maximum of T m at J = jL°.) A gam 
there is an Almeida-Thouless curve which lies beneath the D1RSB transition line for Jo < J^P 
but is coincident with the C1RSB transition line for < Jo < Jc ^ where Jc is the value of 
Jo at which /i e g = h c . 

The transitions are apparent in f(M) through behaviour directly analogous to that discussed 
above for r = 1. In the case of r = 2 the ferromagnetic onsets are second order, with the 
minimum in f(M) moving away from M = continuously as Jo is increased across the transition 
lines. Figure illustrates several aspects of the phase diagram: 0(a) shows a region of non- 
glassy ferromagnetism above T m , where f(M) is RS throughout its range; 0(b) shows a non-glassy 
ferromagnet between T m and T s ° for Jo < Jm , with a gap in the RS curve and an RSB section 
but with the minimum in the lower RS region; 0(c) shows a glassy ferromagnet at the same 
temperature, where the minimum is now in the RSB region, the system having undergone a 
D1RSB transition; 0(d) shows a non-glassy ferromagnet at the same temperature for Jo > Jm\ 
with the minimum now in the upper RS region, the system having undergone a C1RSB transition. 

For r > 2 the ferromagnetic transitions are first order, with the M — solution always locally 
stable. As noted before, there are two kinds of transition as Jo is increased or T is decreased: a 
spinodal transition at which a secondary minimum appears in f(M) at a finite M whilst the lowest 
minimum is at AI — 0, and a thermodynamic transition at which the finite M minimum becomes 
lower than that at M = 0. Figures 0-0 show the full phase diagrams for p = 4 and r = 3,4,5 
respectively, as characteristic illustrations of systems with first order transitions for which r is less 
than, equal to, and greater than p. Only for the case r < p is a glassy ferromagnet found with 
glassy /non-glassy transitions; this transition is analogous to that for the case r = 2, with D1RSB 
for J less than and C1RSB for J > ■ Figure illustrates the underlying character of 
f(M), which drives the static transitions. Figures 0(a,b) show the situation for T > T m , (a) in 
a region of spinodal ferromagnetism, (b) of thermodynamic ferromagnetism. Figures 0(c— f) are 
for T < T s °, showing the effect of increasing Jo: (c) is in the spin glass phase, passing to an 
RSB ferromagnet (d) via a spinodal transition, with the RSB ferromagnet thermodynamically 
preferable to the spin glass in (e), and eventually crossing via a continuous transition into an RS 
ferromagnet in (f). The smallest self-consistent value of h c g (i.e. that at the spinodal transition) 
increases with r, and in fact for r = p at any T < T m it is exactly that corresponding to the 
C1RSB line in Figure so that the transition is directly into an RS ferromagnet. This is shown 
in Figure 0(a). (Note that since the C1RSB line coincides with the Almeida-Thouless line, the 
RS ferromagnet does become unstable against RSB fluctuations at the transition.) For r > p 
the smallest h e g is beyond this critical value and carries the system well into the RS region, so 
there is no trace of an RSB ferromagnet. This is shown in Figure 0(b). Hence for all r ^ p 
glassy ferromagnetism is suppressed. In the case of r = p the minimum h e g corresponds to the 
same value of Jo for any T < T m , yielding a vertical transition line between spin-glass and RS 
ferromagnet. 

For r > p (as in Figure 0) the ferromagnet becomes marginally stable against small fluctuations 
in M along its spinodal transition line F^ S (M) = 0. The corresponding thermodynamic transition 
line is in two segments: for T > T s ° it is given by Ffm = FpW, whilst for T < T s ° it is where 
-Ffm = Fsq. For r = p (as in Figure 0) the spinodal transition is also in two segments: for 
both segments it has F^ S (M) = as before, but in the lower section (T < T m ) it simultaneously 
becomes unstable against Almeida-Thouless fluctuations. The thermodynamic transition is as for 
r > p. For r < p (as in Figure 0) the spinodal transition line to glassy ferromagnetism is in three 
segments (see Figure [lC]): (A) the C1RSB line where qi — q and i / 1; (B) the D1RSB line 
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where x = 1 and q\ ^ qo; (C) the line F^ SB (M) = 0, where it is marginally stable against small 
fluctuations in M again. Non-glassy ferromagnetism onsets at F^L(M) = 0, as shown by curve 
(D) which terminates where it intersects (B). The static and dynamic results are qualitatively 
the same, although the lines (B) and (C) are slightly displaced. The thermodynamic transition 
lines are as the spinodal lines for the continuous transitions, but for the first order ferromagnetic 
transitions are moved to higher Jo. This curve is in three segments: (C) has moved to the line 
Fsg = -Pgpm; the lower section of (B) to Fpm = -Fgfm! (D) has moved to Fpm = -Ffm- 

6 Conclusions 

In this paper we have solved the infinite range spherical p-spin glass with an additional r-spin 
ferromagnetic interaction, finding the phase diagrams both in statics and dynamics for p > 2 and 
general r. By further examination of the free energy with constrained magnetization we have 
clarified the origin of the different phases, both for the previously studied models with r = 1,2 
and for r > 2. We have related the behaviour of systems with r ^ 2 to those with r = 1. In all 
cases, in the replica method, the first step of replica symmetry breaking is sufficient. As previously 
noted Q, for r = 2 there are thermodynamically continuous transitions to ferromagnetism with 
two types of ferromagnetic region, non-glassy and glassy (Figure |J). For r > 2 the ferromagnet 
transitions are first order. For r < p there remains a region of parameter space where the system 
favours a glassy ferromagnet (Figure |J), whereas for r ^ p glassy ferromagnetism is suppressed 
and the ferromagnetic region consists of a single non-glassy phase (Figures |], ||) . 

Acknowledgments 

The authors would like to thank Andrea Cavagna, Irene Giardina, Juan-Pedro Garrahan and John 
Hertz for helpful discussions. We would also like to thank EPRSC (UK) for financial support, PG 
for research studentship 97304251 and DS for research grant GR/M04426. 



G 



References 

[1] A. Crisanti and H.-J. Sommcrs, Z. Phys. B 87, 341 (1992). 

[2] A. Crisanti, H. Horner, and H.-J. Sommcrs, Z. Phys. B 92, 257 (1993). 

[3] J. A. Hertz, D. Sherrington, and T. M. Nieuwcnhuizen, Phys. Rev. E 60, 2460 (1998). 

[4] J. A. Mydosh, Spin glasses: an experimental introduction (Taylor and Francis, 1993). 

[5] J. A. Hertz, A. Krogh, and R. G. Palmer, Introduction to the theory of neural computation 
(Addison-Wesley, 1991). 

[6] P. G. Wolyncs, J. N. Onuchic, and D. Thirumalai, Science 267, 1619 (1995). 

[7] N. Sourlas, Nature 339, 693 (1989). 

[8] M. Mezard, G. Parisi, and M. A. Virasoro, Spin Glass Theory and Beyond (World Scientific, 
1987). 

[9] D. Sherrington, "Spin Glasses", in Physics of Novel Materials (World Scientific, 1999), edited 
by M. P. Das. 

[10] G. Parisi, J. Phys. A 13, 1101 (1979). 

[11] H. Sompolinsky and A. Zippclius, Phys. Rev. B 25, 6860 (1982). 

[12] T. R. Kirkpatrick and D. Thirumalai, Phys. Rev. B 36, 5388 (1987). 

[13] L. F. Cugliandolo and J. Kurchan, Phys. Rev. Lett. 71, 173 (1993). 



7 



t 

1 r 




Figure 1: The phase diagram the spin glass with p — 4 in a magnetic field h fl|,|2|]. The axes are 
j = h/J and t — T / J . The static result is shown by the solid line; where the dynamic result differs 
it is shown by the dashed line. The transitions are D1RSB to the left of the maximum and C1RSB 
to the right. The dotted line is the continuation of the Almeida-Thouless stability line where it 
does not coincide with the C1RSB. For p — 4, the static and dynamic transition temperatures are 
T s ° fa 0.503 J and T° w 0.544 J at h = 0, and both peak at T = T m ps 0.612 J,h= h m = J/y/2 
and fall to zero at h = h c = 2 J. 




Figure 2: The phase diagram for p = 4 and r = 2. || The axes are j = Jo/ J and t = T/J. The 
static results are shown by the solid lines; where the dynamic results differ they are shown by the 
dashed lines. Transitions to glassy behaviour are D1RSB to the left of the maximum and C1RSB 
to the right. 
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Figure 3: The phase diagram for p = 4 and r = 3. The axes are j = Jo/ J and t = T/J. The static 
spinodal results are shown by the solid lines; where the dynamic results differ they are shown by 
the dashed line. The dot-dashed line shows the thermodynamic transitions. Transitions to glassy 
behaviour are Df RSB to the left of the maximum and C1RSB to the right. 




Figure 4: The phase diagram for p = r = 4. The axes are j = Jo/ J and t = T/J. The static 
spinodal results are shown by the solid lines; where the dynamic results differ they are shown by 
the dashed line. The dot-dashed line shows the thermodynamic transitions. 
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Figure 5: The phase diagram for p = 4 and r = 5. The axes are j = Jq/J and t = T/J. The static 
spinodal results are shown by the solid lines; where the dynamic results differ they are shown by 
the dashed line. The dot-dashed line shows the thermodynamic transitions. 
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(c) T/J = 0.505, Jo = (close-up) (d) T/J = 0.45, J = 

Figure 6: Plots of the free energy per site / against the constrained magnetization M at various 
temperatures when Jo = 0. (In this case there is no dependence on r.) The solid lines give the 
RS solutions, the dashed lines the RSB. 



10 




(a) r = 2, T/J = 0.7, J /J = 1 (b) r = 2, T/J = 0.55, J /J = 0.6 




(c) r = 2, T/J = 0.55, J /J = 1.3 (d) r = 2, T/J = 0.55, J /J = 2.4 



Figure 7: Plots of the free energy per site / against the constrained magnetization M at various 
points in the phase diagram when r = 2. The solid lines give the RS solutions, the dashed lines 
the RSB. 
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(a) r = 3, T/J = 0.7, J /J = 2.1 



(b) r = 3, T/J = 0.7, J /J = 2.5 
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(c) r = 3, T/J = 0.3, Jo/ J = 1.8 



(d) r = 3, T/J = 0.3, J /J = 2 
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(e) r = 3, T/J = 0.3, J /J = 2.5 



(f) r = 3, T/J = 0.3, J /J = 3 



Figure 8: Plots of the free energy per site / against the constrained magnetization M at various 
points in the phase diagram when r = 3. The solid lines give the RS solutions, the dashed lines 
the RSB. 
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(a) r = 4, T/J = 0.3, J /J = 3.7 



(b) r = 5, T/J = 0.3, J /J = 4.7 



Figure 9: Plots of the free energy per site / against the constrained magnetization M at a point 
near the spinodal transition between spin glass and ferromagnet for r = 4 and r — 5. The solid 
lines give the RS solutions, the dashed lines the RSB. 
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Figure 10: A detail of the dynamic spinodal phase diagram for p — 4 and r = 3 shown in Figure |3|. 
The axes are j = Jq/J and t = T/J. The solid lines are the actual phase transition lines, the 
dashed lines are their continuations into regions where they are superseded by earlier transitions. 
For clarity, the points where the various curves meet are marked with dots. A qualitatively similar 
figure applies for the static spinodal lines. The onset of the glassy ferromagnet is given by 1RSB 
solutions to (@), (^|), (|l(i|), and fli"i"|), with M/0 and the additional constraints q\ = q on (A), 
x — 1 on (B), and F^ SB (M) = on (C). The onset of the non-glassy ferromagnet is given by RS 
solutions to the equations with M ^ and F£ S (M) — 0, and is shown by (D). The onset of the 
spin glass is given by 1RSB solutions to the equations with M = and x = 1, and is shown by 
(E). 
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